winston
A multi-transport async logging library for node.js. "CHILL WINSTON! ... I put it in the logs."
Motivation
Winston is designed to be a simple and universal logging library with support for multiple transports. A transport is essentially a storage device for your logs. Each instance of a winston logger can have multiple transports configured at different levels. For example, one may want error logs to be stored in a persistent remote location (like a database), but all logs output to the console or a local file.
There also seemed to be a lot of logging libraries out there that coupled their implementation of logging (i.e. how the logs are stored / indexed) to the API that they exposed to the programmer. This library aims to decouple those parts of the process to make it more flexible and extensible.
Installation
npm install winston
Usage
There are two different ways to use winston: directly via the default logger, or by instantiating your own Logger. The former is merely intended to be a convenient shared logger to use throughout your application if you so choose.
Logging
Using the Default Logger
The default logger is accessible through the winston module directly. Any method that you could call on an instance of a logger is available on the default logger:
var winston = require('winston');
winston.log('info', 'Hello distributed log files!');
winston.info('Hello again distributed logs');
By default, only the Console transport is set on the default logger. You can add or remove transports via the add() and remove() methods:
winston.add(winston.transports.File, { filename: 'somefile.log' });
winston.remove(winston.transports.Console);
For more documentation about working with each individual transport supported by Winston see the Working with transports section below.
Instantiating your own Logger
If you would prefer to manage the object lifetime of loggers you are free to instantiate them yourself:
var logger = new (winston.Logger)({
transports: [
new (winston.transports.Console)(),
new (winston.transports.File)({ filename: 'somefile.log' })
]
});
You can work with this logger in the same way that you work with the default logger:
logger.log('info', 'Hello distributed log files!');
logger.info('Hello again distributed logs');
logger.add(winston.transports.File)
.remove(winston.transports.Console);
Logging with Metadata
In addition to logging string messages, winston will also optionally log additional JSON metadata objects. Adding metadata is simple:
winston.log('info', 'Test Log Message', { anything: 'This is metadata' });
The way these objects are stored varies from transport to transport (to best support the storage mechanisms offered). Here's a quick summary of how each transports handles metadata:
- Console: Logged via util.inspect(meta)
- File: Logged via util.inspect(meta)
Multiple transports of the same type
It is possible to use multiple transports of the same type e.g. winston.transports.File
by passing in a custom name
when you construct the transport.
var logger = new (winston.Logger)({
transports: [
new (winston.transports.File)({
name: 'info-file',
filename: 'filelog-info.log',
level: 'info'
}),
new (winston.transports.File)({
name: 'error-file',
filename: 'filelog-error.log',
level: 'error'
})
]
});
If you later want to remove one of these transports you can do so by using the string name. e.g.:
logger.remove('info-file');
In this example one could also remove by passing in the instance of the Transport itself. e.g. this is equivalent to the string example above;
// Notice it was first in the Array above
var infoFile = logger.transports[0];
logger.remove(infoFile);
Profiling
In addition to logging messages and metadata, winston also has a simple profiling mechanism implemented for any logger:
winston.profile('test');
setTimeout(function () {
winston.profile('test');
}, 1000);
All profile messages are set to the 'info' by default and both message and metadata are optional There are no plans in the Roadmap to make this configurable, but I'm open to suggestions / issues.
String interpolation
The log
method provides the same string interpolation methods like util.format
.
This allows for the following log messages.
logger.log('info', 'test message %s', 'my string');
logger.log('info', 'test message %d', 123);
logger.log('info', 'test message %j', {number: 123}, {});
logger.log('info', 'test message %s, %s', 'first', 'second', {number: 123});
logger.log('info', 'test message', 'first', 'second', {number: 123});
logger.log('info', 'test message %s, %s', 'first', 'second', {number: 123}, function(){});
logger.log('info', 'test message', 'first', 'second', {number: 123}, function(){});
Querying Logs
Winston supports querying of logs with Loggly-like options. See Loggly Search API.
Specifically: File
, Couchdb
, Redis
, Loggly
, Nssocket
, and Http
.
var options = {
from: new Date - 24 * 60 * 60 * 1000,
until: new Date,
limit: 10,
start: 0,
order: 'desc',
fields: ['message']
};
winston.query(options, function (err, results) {
if (err) {
throw err;
}
console.log(results);
});
Streaming Logs
Streaming allows you to stream your logs back from your chosen transport.
winston.stream({ start: -1 }).on('log', function(log) {
console.log(log);
});
Exceptions
Handling Uncaught Exceptions with winston
With winston
, it is possible to catch and log uncaughtException
events from your process. There are two distinct ways of enabling this functionality either through the default winston logger or your own logger instance.
If you want to use this feature with the default logger simply call .handleExceptions()
with a transport instance.
winston.handleExceptions(new winston.transports.File({ filename: 'path/to/exceptions.log' }))
winston.add(winston.transports.File, {
filename: 'path/to/all-logs.log',
handleExceptions: true
});
To Exit or Not to Exit
By default, winston will exit after logging an uncaughtException. if this is not the behavior you want,
set exitOnError = false
var logger = new (winston.Logger)({ exitOnError: false });
logger.exitOnError = false;
When working with custom logger instances, you can pass in separate transports to the exceptionHandlers
property or set .handleExceptions
on any transport.
Example 1
var logger = new (winston.Logger)({
transports: [
new winston.transports.File({ filename: 'path/to/all-logs.log' })
],
exceptionHandlers: [
new winston.transports.File({ filename: 'path/to/exceptions.log' })
]
});
Example 2
var logger = new winston.Logger({
transports: [
new winston.transports.Console({
handleExceptions: true,
json: true
})
],
exitOnError: false
});
The exitOnError
option can also be a function to prevent exit on only certain types of errors:
function ignoreEpipe(err) {
return err.code !== 'EPIPE';
}
var logger = new (winston.Logger)({ exitOnError: ignoreEpipe });
logger.exitOnError = ignoreEpipe;
Logging Levels
Using Logging Levels
Setting the level for your logging message can be accomplished in one of two ways. You can pass a string representing the logging level to the log() method or use the level specified methods defined on every winston Logger.
logger.log('silly', "127.0.0.1 - there's no place like home");
logger.log('debug', "127.0.0.1 - there's no place like home");
logger.log('verbose', "127.0.0.1 - there's no place like home");
logger.log('info', "127.0.0.1 - there's no place like home");
logger.log('warn', "127.0.0.1 - there's no place like home");
logger.log('error', "127.0.0.1 - there's no place like home");
logger.info("127.0.0.1 - there's no place like home");
logger.warn("127.0.0.1 - there's no place like home");
logger.error("127.0.0.1 - there's no place like home");
winston.log('info', "127.0.0.1 - there's no place like home");
winston.info("127.0.0.1 - there's no place like home");
Winston allows you to set a level
on each transport that specifies the level of messages this transport should log. For example, you could log only errors to the console, with the full logs in a file (note that the default level of a transport is info
):
var logger = new (winston.Logger)({
transports: [
new (winston.transports.Console)({ level: 'error' }),
new (winston.transports.File)({ filename: 'somefile.log' })
]
});
You may also dynamically change the log level of a transport:
var logger = new (winston.Logger)({
transports: [
new (winston.transports.Console)({ level: 'warn' }),
new (winston.transports.File)({ filename: 'somefile.log', level: 'error' })
]
});
logger.debug("Will not be logged in either transport!");
logger.transports.console.level = 'debug';
logger.transports.file.level = 'verbose';
logger.verbose("Will be logged in both transports!");
As of 0.2.0, winston supports customizable logging levels, defaulting to npm style logging levels. Changing logging levels is easy:
winston.setLevels(winston.config.syslog.levels);
logger.setLevels(winston.config.syslog.levels);
Calling .setLevels
on a logger will remove all of the previous helper methods for the old levels and define helper methods for the new levels. Thus, you should be careful about the logging statements you use when changing levels. For example, if you ran this code after changing to the syslog levels:
logger.silly('some silly message');
Using Custom Logging Levels
In addition to the predefined npm
and syslog
levels available in Winston, you can also choose to define your own:
var myCustomLevels = {
levels: {
foo: 0,
bar: 1,
baz: 2,
foobar: 3
},
colors: {
foo: 'blue',
bar: 'green',
baz: 'yellow',
foobar: 'red'
}
};
var customLevelLogger = new (winston.Logger)({ levels: myCustomLevels.levels });
customLevelLogger.foobar('some foobar level-ed message');
Although there is slight repetition in this data structure, it enables simple encapsulation if you not to have colors. If you do wish to have colors, in addition to passing the levels to the Logger itself, you must make winston aware of them:
winston.addColors(myCustomLevels.colors);
This enables transports with the 'colorize' option set to appropriately color the output of custom levels.
Further Reading
Events and Callbacks in Winston
Each instance of winston.Logger is also an instance of an EventEmitter. A log event will be raised each time a transport successfully logs a message:
logger.on('logging', function (transport, level, msg, meta) {
});
logger.info('CHILL WINSTON!', { seriously: true });
It is also worth mentioning that the logger also emits an 'error' event which you should handle or suppress if you don't want unhandled exceptions:
logger.on('error', function (err) { });
logger.emitErrs = false;
Every logging method described in the previous section also takes an optional callback which will be called only when all of the transports have logged the specified message.
logger.info('CHILL WINSTON!', { seriously: true }, function (err, level, msg, meta) {
});
Working with multiple Loggers in winston
Often in larger, more complex applications it is necessary to have multiple logger instances with different settings. Each logger is responsible for a different feature area (or category). This is exposed in winston
in two ways: through winston.loggers
and instances of winston.Container
. In fact, winston.loggers
is just a predefined instance of winston.Container
:
var winston = require('winston');
winston.loggers.add('category1', {
console: {
level: 'silly',
colorize: 'true',
label: 'category one'
},
file: {
filename: '/path/to/some/file'
}
});
winston.loggers.add('category2', {
couchdb: {
host: '127.0.0.1',
port: 5984
}
});
Now that your loggers are setup you can require winston in any file in your application and access these pre-configured loggers:
var winston = require('winston');
var category1 = winston.loggers.get('category1');
category1.info('logging from your IoC container-based logger');
If you prefer to manage the Container
yourself you can simply instantiate one:
var winston = require('winston'),
container = new winston.Container();
container.add('category1', {
console: {
level: 'silly',
colorize: 'true'
},
file: {
filename: '/path/to/some/file'
}
});
Sharing transports between Loggers in winston
var winston = require('winston');
winston.loggers.options.transports = [
];
var container = new winston.Container({
transports: [
]
});
winston.loggers.add('some-category', {
transports: [
]
});
container.add('some-category', {
transports: [
]
});
Using winston in a CLI tool
A common use-case for logging is output to a CLI tool. Winston has a special helper method which will pretty print output from your CLI tool. Here's an example from the require-analyzer written by Nodejitsu:
info: require-analyzer starting in /Users/Charlie/Nodejitsu/require-analyzer
info: Found existing dependencies
data: {
data: colors: '0.x.x',
data: eyes: '0.1.x',
data: findit: '0.0.x',
data: npm: '1.0.x',
data: optimist: '0.2.x',
data: semver: '1.0.x',
data: winston: '0.2.x'
data: }
info: Analyzing dependencies...
info: Done analyzing raw dependencies
info: Retrieved packages from npm
warn: No additional dependencies found
Configuring output for this style is easy, just use the .cli()
method on winston
or an instance of winston.Logger
:
var winston = require('winston');
winston.cli();
var logger = new winston.Logger({
transports: [
new (winston.transports.Console)()
]
});
logger.cli();
Extending another object with Logging
Often in a given code base with lots of Loggers it is useful to add logging methods to a different object so that these methods can be called with less syntax. Winston exposes this functionality via the 'extend' method:
var myObject = {};
logger.extend(myObject);
myObject.info("127.0.0.1 - there's no place like home");
Filters
Filters allow modifying the contents of log messages, e.g. to mask data that
should not appear in logs.
logger.addFilter(function(msg) {
return maskCardNumbers(msg);
});
logger.info('transaction with card number 123456789012345 successful.');
This may result in this output:
info: transaction with card number 123456****2345 successful.
See log-filter-test.js, where card number masking
is implemented as an example.
Working with Transports
There are many transports supported by winston core. If you have a transport you would like to add either open an issue or fork and submit a pull request. Commits are welcome, but I'll give you extra street cred if you add tests too :D
Console Transport
winston.add(winston.transports.Console, options)
The Console transport takes a few simple options:
- level: Level of messages that this transport should log (default 'info').
- silent: Boolean flag indicating whether to suppress output (default false).
- colorize: Boolean flag indicating if we should colorize output (default false).
- timestamp: Boolean flag indicating if we should prepend output with timestamps (default false). If function is specified, its return value will be used instead of timestamps.
- prettyPrint: Boolean flag indicating if we should
util.inspect
the meta (default false). If function is specified, its return value will be the string representing the meta. - depth Numeric indicating how many times to recurse while formatting the object with
util.inspect
(only used with prettyPrint: true
) (default null, unlimited) - showLevel: Boolean flag indicating if we should prepend output with level (default true).
- formatter: If function is specified, its return value will be used instead of default output. (default undefined)
Metadata: Logged via util.inspect(meta);
File Transport
winston.add(winston.transports.File, options)
The File transport should really be the 'Stream' transport since it will accept any WritableStream. It is named such because it will also accept filenames via the 'filename' option:
- level: Level of messages that this transport should log.
- silent: Boolean flag indicating whether to suppress output.
- colorize: Boolean flag indicating if we should colorize output.
- timestamp: Boolean flag indicating if we should prepend output with timestamps (default true). If function is specified, its return value will be used instead of timestamps.
- filename: The filename of the logfile to write output to.
- maxsize: Max size in bytes of the logfile, if the size is exceeded then a new file is created, a counter will become a suffix of the log file.
- maxFiles: Limit the number of files created when the size of the logfile is exceeded.
- stream: The WriteableStream to write output to.
- json: If true, messages will be logged as JSON (default true).
- prettyPrint: If true, additional JSON metadata objects that are added to logging string messages will be displayed as a JSON string representation. If function is specified, its return value will be the string representing the meta.
- depth Numeric indicating how many times to recurse while formatting the object with
util.inspect
(only used with prettyPrint: true
) (default null, unlimited) - logstash: If true, messages will be logged as JSON and formatted for logstash (default false).
- showLevel: Boolean flag indicating if we should prepend output with level (default true).
- formatter: If function is specified, its return value will be used instead of default output. (default undefined)
- tailable: If true, log files will be rolled based on maxsize and maxfiles, but in ascending order. The filename will always have the most recent log lines. The larger the appended number, the older the log file.
Metadata: Logged via util.inspect(meta);
Daily Rotate File Transport
winston.add(winston.transports.DailyRotateFile, options)
The Daily Rotate File transport lets you rotate log files based on time.
In addition to the options accepted by the File transport, the Daily Rotate File Transport also accepts the following option.
- datePattern: Defines rolling time of a log file and suffix appended to the file. Following meta characters can be used:
yy
, yyyy
, M
, MM
, d
, dd
, H
, HH
, m
, mm
. The default pattern is '.yyyy-MM-dd'
. Rotation time of the log file will be equal to the smallest given time token timespan, so '.yyyy-MM-ddTHH'
will rotate logfile every hour. You can not rotate files more frequent then every minute.
Loggly Transport
var Loggly = require('winston-loggly').Loggly
winston.add(Loggly, options);
The Loggly transport is based on Nodejitsu's node-loggly implementation of the Loggly API. If you haven't heard of Loggly before, you should probably read their value proposition. The Loggly transport takes the following options. Either 'inputToken' or 'inputName' is required:
- level: Level of messages that this transport should log.
- subdomain: The subdomain of your Loggly account. [required]
- auth: The authentication information for your Loggly account. [required with inputName]
- inputName: The name of the input this instance should log to.
- inputToken: The input token of the input this instance should log to.
- json: If true, messages will be sent to Loggly as JSON.
Metadata: Logged in suggested Loggly format
Riak Transport
As of 0.3.0
the Riak transport has been broken out into a new module: winston-riak. Using it is just as easy:
var Riak = require('winston-riak').Riak;
winston.add(Riak, options);
In addition to the options accepted by the riak-js client, the Riak transport also accepts the following options. It is worth noting that the riak-js debug option is set to false by default:
- level: Level of messages that this transport should log.
- bucket: The name of the Riak bucket you wish your logs to be in or a function to generate bucket names dynamically.
var singleBucketTransport = new (Riak)({ bucket: 'some-logs-go-here' });
var dynamicBucketTransport = new (Riak)({
bucket: function (level, msg, meta, now) {
var d = new Date(now);
return level + [d.getDate(), d.getMonth(), d.getFullYear()].join('-');
}
});
Metadata: Logged as JSON literal in Riak
MongoDB Transport
As of 0.3.0
the MongoDB transport has been broken out into a new module: winston-mongodb. Using it is just as easy:
var MongoDB = require('winston-mongodb').MongoDB;
winston.add(MongoDB, options);
For more information about its arguments, check winston-mongodb's README.
- level: Level of messages that this transport should log.
- silent: Boolean flag indicating whether to suppress output.
- db: The name of the database you want to log to. [required]
- collection: The name of the collection you want to store log messages in, defaults to 'log'.
- safe: Boolean indicating if you want eventual consistency on your log messages, if set to true it requires an extra round trip to the server to ensure the write was committed, defaults to true.
- host: The host running MongoDB, defaults to localhost.
- port: The port on the host that MongoDB is running on, defaults to MongoDB's default port.
Metadata: Logged as a native JSON object.
3b57730... Custom log formatter functionality were added.
SimpleDB Transport
The winston-simpledb transport is just as easy:
var SimpleDB = require('winston-simpledb').SimpleDB;
winston.add(SimpleDB, options);
The SimpleDB transport takes the following options. All items marked with an asterisk are required:
- awsAccessKey:* your AWS Access Key
- secretAccessKey:* your AWS Secret Access Key
- awsAccountId:* your AWS Account Id
- domainName:* a string or function that returns the domain name to log to
- region:* the region your domain resides in
- itemName: a string ('uuid', 'epoch', 'timestamp') or function that returns the item name to log
Metadata: Logged as a native JSON object to the 'meta' attribute of the item.
Mail Transport
The winston-mail is an email transport:
var Mail = require('winston-mail').Mail;
winston.add(Mail, options);
The Mail transport uses emailjs behind the scenes. Options are the following:
- to: The address(es) you want to send to. [required]
- from: The address you want to send from. (default:
winston@[server-host-name]
) - host: SMTP server hostname (default: localhost)
- port: SMTP port (default: 587 or 25)
- username User for server auth
- password Password for server auth
- ssl: Use SSL (boolean or object { key, ca, cert })
- tls: Boolean (if true, use starttls)
- level: Level of messages that this transport should log.
- silent: Boolean flag indicating whether to suppress output.
Metadata: Stringified as JSON in email.
Amazon SNS (Simple Notification System) Transport
The winston-sns transport uses amazon SNS to send emails, texts, or a bunch of other notifications.
require('winston-sns').SNS;
winston.add(winston.transports.SNS, options);
Options:
- aws_key: Your Amazon Web Services Key. [required]
- aws_secret: Your Amazon Web Services Secret. [required]
- subscriber: Subscriber number - found in your SNS AWS Console, after clicking on a topic. Same as AWS Account ID. [required]
- topic_arn: Also found in SNS AWS Console - listed under a topic as Topic ARN. [required]
- region: AWS Region to use. Can be one of:
us-east-1
,us-west-1
,eu-west-1
,ap-southeast-1
,ap-northeast-1
,us-gov-west-1
,sa-east-1
. (default: us-east-1
) - subject: Subject for notifications. (default: "Winston Error Report")
- message: Message of notifications. Uses placeholders for level (%l), error message (%e), and metadata (%m). (default: "Level '%l' Error:\n%e\n\nMetadata:\n%m")
- level: lowest level this transport will log. (default:
info
)
Graylog2 Transport
winston-graylog2 is a Graylog2 transport:
var Graylog2 = require('winston-graylog2').Graylog2;
winston.add(Graylog2, options);
The Graylog2 transport connects to a Graylog2 server over UDP using the following options:
-
level: Level of messages this transport should log. (default: info)
-
silent: Boolean flag indicating whether to suppress output. (default: false)
-
graylogHost: IP address or hostname of the graylog2 server. (default: localhost)
-
graylogPort: Port to send messages to on the graylog2 server. (default: 12201)
-
graylogHostname: The hostname associated with graylog2 messages. (default: require('os').hostname())
-
graylogFacility: The graylog2 facility to send log messages.. (default: nodejs)
Metadata: Stringified as JSON in the full message GELF field.
Papertrail Transport
winston-papertrail is a Papertrail transport:
var Papertrail = require('winston-papertrail').Papertrail;
winston.add(Papertrail, options);
The Papertrail transport connects to a PapertrailApp log destination over TCP (TLS) using the following options:
- level: Level of messages this transport should log. (default: info)
- host: FQDN or IP address of the Papertrail endpoint.
- port: Port for the Papertrail log destination.
- hostname: The hostname associated with messages. (default: require('os').hostname())
- program: The facility to send log messages.. (default: default)
- logFormat: a log formatting function with the signature
function(level, message)
, which allows custom formatting of the level or message prior to delivery
Metadata: Logged as a native JSON object to the 'meta' attribute of the item.
Cassandra Transport
winston-cassandra is a Cassandra transport:
var Cassandra = require('winston-cassandra').Cassandra;
winston.add(Cassandra, options);
The Cassandra transport connects to a cluster using the native protocol with the following options:
- level: Level of messages that this transport should log (default:
'info'
). - table: The name of the Cassandra column family you want to store log messages in (default:
'logs'
). - partitionBy: How you want the logs to be partitioned. Possible values
'hour'
and 'day'
(Default). - consistency: The consistency of the insert query (default:
quorum
).
In addition to the options accepted by the Node.js Cassandra driver Client.
- hosts: Cluster nodes that will handle the write requests:
Array of strings containing the hosts, for example
['host1', 'host2']
(required). - keyspace: The name of the keyspace that will contain the logs table (required). The keyspace should be already created in the cluster.
Adding Custom Transports
Adding a custom transport (say for one of the datastore on the Roadmap) is actually pretty easy. All you need to do is accept a couple of options, set a name, implement a log() method, and add it to the set of transports exposed by winston.
var util = require('util'),
winston = require('winston');
var CustomLogger = winston.transports.CustomerLogger = function (options) {
this.name = 'customLogger';
this.level = options.level || 'info';
};
util.inherits(CustomLogger, winston.Transport);
CustomLogger.prototype.log = function (level, msg, meta, callback) {
callback(null, true);
};
Custom Log Format
To specify custom log format you should set formatter function for transport. Currently supported transports are: Console, File, Memory.
Options object will be passed to the format function. It's general properties are: timestamp, level, message, meta. Depending on the transport type may be additional properties.
var logger = new (winston.Logger)({
transports: [
new (winston.transports.Console)({
timestamp: function() {
return Date.now();
},
formatter: function(options) {
return options.timestamp() +' '+ options.level.toUpperCase() +' '+ (undefined !== options.message ? options.message : '') +
(options.meta && Object.keys(options.meta).length ? '\n\t'+ JSON.stringify(options.meta) : '' );
}
})
]
});
logger.info('Data to log.');
Inspirations
- npm
- log.js
- socket.io
- node-rlog
- BigBrother
- Loggly
Installation
Installing npm (node package manager)
curl http://npmjs.org/install.sh | sh
Installing winston
[sudo] npm install winston
Run Tests
All of the winston tests are written in vows, and designed to be run with npm.
$ npm test